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ABSTRACT 


Sixty Naval Postgraduate School students served in a verbal discrimi- 
nation (VD) experiment with 2-, 3-, and 4-word items at presentation rates 
of 4 or + bits of information per second. Half the items had similar and 
half, dissimilar words. Based on information theory, lists of different 
lengths were prepared for 2-, 3-, and 4-word items. The lists were equated 
for overall load at 20 bits of information. Performance was consistent 
with the equal-load hypothesis and a differential of two was observed be- 
cause of the rate factor. Analysis of percent correct responses revealed 
a Significance for the item length main effect which was at variance with 


the null hypothesis of no difference borne out by the information analysis. 
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I. INTRODUCTION 


Verbal learning is a form of leaming in which all persons engage, and 
which is an integral part of educational procedures. Verbal discrimination 
(VD) is a method of presenting verbal material for learning. A set of 
words (called an item) is presented to the subject, and he must select the 
one that has been arbitrarily selected as correct by the experimenter. * A 
VD list of items is selected and presented to the subject; one complete 
presentation of the list is called < trial and on successive trials the 
words within an item and the items themselves are presented in different 
orders. Some studies have used a blank interval between presentations of 
each item. 

On the first trial of a VD task the subject is requested to make a 
guess for each item as to the correct word. In the contingent method, his 
response, if correct, is usually reinforced by the experimenter who records 
each response the subject makes. In subsequent trials, it is hoped thai 
the subject will learn the correct words in the list through this rein- 
forcement and that the experimenter will be able to analyze these responses 
in order to measure the amount of learning incurred. 

Learning difficulty varies as the number of choices within each item 
(Underwood and Freund 1969). Zacks (1969) has shown that the total learn- 
ing time tends to be invariant over various conditions of practice for a 
fixed task load. Gray (1971) has demonstrated that information analysis 
of VD tasks provides additional information over conventional methods of 


analyzing VD learning. For example, the information measure provides an 


Time usual method is by use of a random choice mechanism. 





absolute measure of learning regardless of the number of alternatives, 
whereas a measure such as the percentage of correct responses will vary 
according to the number of alternatives. Information measures, when the 
responses are summed over individuals, also provide information regarding 
the patterning of choices over all the alternatives considered simultane- 
ously. That is, when the initial probability of choice for each word in 
a VD list can be estimated, the transfer of information contained within 
the list may then be measured by the distribution of responses among 
choices over repeated trials. Thus, learning can be analyzed as the re- 
duction in uncertainty of subjects' responses from the uncertainty initially 
present in the item. 

If all the choices within an item are equally likely, then the in- 
formation content of the item is simply defined as 


I = log,N 


where N equals the number of words within the item. Hence, a 2-word item 
Nace) bit of information; a 3-word item, 1.585 bits; a 4d-word item, 2 bits, 
etc. 

In the general case, considering a list of m items, each containing 


n-words, the information content would be 


m n 
I= - be 2 (p,log,p, ) 

where k is the k-th item within the list and Ps is the probability of 

occurrence of the i-th word within the k-th iten. Ps may also be expressed 

as the a priori probability of choice for each word within the VD item. 

Using these notions, this study examined the learning of 2-, 3-, and 4- 


word items using two information (stimulus) presentation rates. This is 





in contrast to Gray's (1971) study in which he used two presentation times 
regardless of the information content of the stimulus. When the informa- 
tion load for each list is approximately the same and the information 
presentation rate is constant (regardless of the number of words in an 
item), there should be no difference in the information presentation rates; 
difference in performance should be proportional to the differences in 


presentation rates. 


IIT. METHOD 


A. WORD LISTS 

Three word lists (Table I), one for each of the 2-, 3-, and 4-word 
treatments, constrained to a maximum uncertainty of 20 eatoan were con- 
structed. For the uncertainty level selected, lists of 20, 12, and 10 VD 
items were required for the 2-, 3-, and 4-word treatments, respectively. 
To insure the equal a priori probability of selection on the first trial 
and to reduce the rate of learning bias (Sidowski, 1966), three criteria 
were used in determining the words in each list. First, these words were 
selected from categories having at least a 0.9 correlation over test sub- 
jects in the category norms for verbal items compiled by Battig and Mon- 
tague (1969). Secondly, similarity was established by selecting the words 
of an item from a single category. Half of the items in each list were 
composed in this manner; the remaining items contained dissimilar group- 
ings. Finally, the frequence of occurrence of each word in written ma- 


terial was examined using the Thorndike and Lorge (1944) general count. 


“In order to maintain list compatability for similar and dissimilar 
words, the 3-word VD list contained 19.02 bits of uncertainty. 





WORD LISTS FOR 2- -WORD TREATMENTS 
























TWO-WORD TREATMENTS 


murder wine* juice doli* 
apple river* book lake* 
iron yard* nail swim* 
tea coffee temple rock* 
table chair cotton salt* 
mother father bus gun* 
cat dog water door* 
eye head car train 
foot mile red blue 
corn bean hour 





THREE-VWORD TREATMENTS 


door temple water* 
brother mother father 
green blue red 
lake book table* 
cotton hours salt* 
apple knife cat* 
iron yard doctor* 
eye head foot 
minute hour second 
nai river rock 
boat train car 


nail oil swim* 







FOUR-WORD TREATMENTS 














mother sister hour father 
door private temple water* 


eye foot nose head 
swim nail wine oil* 
Vard doctor iron book* 
yellow blue green red 
lake rock river hill 
cotton Sat house table* 
cat murder knife apple* 


year minute hour second 






*Denotes dissimilar word groups.. First word in each iten 
was used as the correct response with the experiment. 





In this respect, all words were required to be members of the AA or A 


frequency group. 


B. CONDITIONS AND PROCEDURES 
From each of the three word lists two treatments were constructed. 
One treatment from each list was randomly assigned to one of two presen- 
tation rate groups, yielding six treatments. Each treatment consisted of 
two copies of four random arrangements of the items within the respective 
list and a random arrangement of the words within each item; thus, eight 
presentations of each list were used to examine the trends in the results. 
For each list, one word within each item was designated correct by 
random determination, and remained correct throughout the experiment. 
Prior to each treatment, the subjects were read a set of instructions 
on the task and the procedures (Appendix A). ‘The subjects were tested in- 
dividually using a Lafayette high-speed memory drum. The discrimination 
item was presented for a fixed-time interval followed by an inter-item 


interval of the same duration as noted in Table II. ‘The subject viewed 


TABLE II. 


TIME INTERVALS FOR ITEM PRESENTATION 


PRESENTATION RATE 


+ BITS/SEC + BITS/SEC 


2=WORD 
4eWORD 


4-WORD 





the words in an item, chose what he considered the correct word and told 


his choice to the experimenter. This declaration was reinforced with the 


10 





verbal response "correct" from the experimenter when the right word was 
chosen; otherwise, there was no response from the experimenter. Each re- 
sponse from the subject was recorded and formed the basic data for the 


analysis. There were no intertrial breaks. 


C. SUBJECTS 
The 60 subjects were graduate level students at the Naval Postgraduate 
school. They were volunteers and randomly assigned to six study groups, 


of 10 subjects each, associated with each of the six treatments. 


III. RESULTS 


The results will first be analyzed according to the growth of correct 


responses; then an analysis in terms of information transfer findings will 


be made. The percent correct responses per trial by item length and pre- 


sentation rate, by presentation rate, and by item length are shown in Tables 


IIT, IV and V and Figures 1, 2, 53, and 4 respectively. 


TABS LIT 
PERCENT OF CORRECT RESPONSES PER TRIAL 


BY PRESENTATION RATE AND [TE LENGTH 


4 BITS/SEC 








TABLE IV 


PERCENT OF CORRECT RESPONSES PER TRIAL 





BY PRESENTATION RATE 


PRESENTATION RATE 
+ BITS/SEC 1 BITS/SEC 





TABLE V 


PERCENT OF CORRECT RSSPONSES PER TRIAL BY ITEM LENGTH 


ITEM LENGTH 
TRIAL 
2-WORD 4-WORD 4-WORD 
i] 
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As demonstrated by Gray (1971), the analysis of the percent correct 
data (Table VI) shows that the effects for rate, item length, trials, and 
rate x item length are significant with a probability less than 0.01. All 
except the significant interaction were expected. The primary purpose of 
this analysis, however, was to show the significance of item length as a 
variable, since the information analysis to follow predicts the null hypoth- 


esis.(no difference) for item length. 


TABLE VI 


ANALYSIS OF VARIANCE OF PERCENT CORRECT RESPONSES 


SOURCE df MS F 















RATE (A) 1 1254.61 71.22* 
ITEM LENGTH (B) 2 1746.77 80. 33* 
TRIALS (C) 7 Osis Dy 53-32% 
AxB 2 ZOO) 9. 30% 
eo C if 44.98 2oUl 
BxcC 14 26.45 eee 
A x BC 14 21.76 

TOTAL AT *simificant 


The first step in the information analysis was to compute the relative 
frequency that each choice was selected on its first presentation. For 
each item, each word within an item was arbitrarily designated as word 1, 

2, 3, or 4 (depending on the number of choices). Chi-square tests indicated 
that the null hypothesis of equally likely altermatives could not be re- 
jected ( X = .95) Thus, the a priori distribution is upheld by the 
empirical results (a posteriori distribution). The a posteriori probabil- 


ity for each classification is presented in Table VII. 


us| 





TABLE VII 


A POSTERIORI DISTRIBUTION OVER WORD LISTS 


LIST WORD 1 WORD 4 CHI-SQUARL 


21.00 25.200 28.50 25. 0 





WORD 2 WORD 3 

















34.15 37.10 28.75 





50.25 ANS ISLS 





Mc *—= 0.95 


Computing the information transferred required the determination of 
the distribution of choices for each item on each trial. This is accon- 
Plished by determining the number of times each word within an item was 
chosen during each trial within each of the six tasks. This forms a per- 
mutation of choices of either two, three or four words. Using tables of 
P,10E,5D, s the uncertainty for the k-th item is 

ee 2. Pi lOBoPs 
j 
where iis the arbitrary designation of each word within the item. Table 
VIII gives all possible permutations of four numbers whose sum is equal to 
10 (the number of subjects involved in each treatment) and their values of 
Ure It is obvious that when perfect learning occurs, P; for tne correc. 
choice is 1.00 and that there is no longer any uncertainty present in the 


item. Thus, for each test, the uncertainty remaining after each trial is 


Uo = U,. 
Ly 


18 





PERMUTATION 
OF CHOICES 


UNCERTAINTY U 


k 


TABLE VIII 


FOR om, 4-, AND 4-WORD ITEMS 


WITH SUBJECTS (N) = 10 


0.4690 
0.7219 
0.8813 
0.9219 
0.9710 
1.0000 
1.1568 
1.2955 
1.3568 
1.3610 


1.3710 


“2 Py NOB >P5 


PERMUTATION 
OF CHOICES 





1.4855 
1.5220 
1.5710 
1.5710 
1.6855 
1.7220 
1.7610 
1.8465 
1.8955 
1.9220 


1.9710 





The U values for each treatment are shown in Table IX. Figures 5 and 6 


graphically present this data. 
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TABLE IX 


UNCERTAINTY REMAINING PER PRESENTATION RATE OVER TRIALS 


+ BITS/SEC a BITS/SEC 


2=-WORDS 3-WORDS 4-WORDS 2~WORDS 3-WORDS 4-WORDS 





This experiment conforms to a 2 x 3 x 8 randomized factorial fixed 
effects model; thus an analysis of variance over trials was conducted 
using nonrepeated measures. The basic datum for the analysis was the 
uncertainty remaining for each of 6 (item length 3 | x presentation 
rate [ 2] ) treatments for each of eight trials making a total of 47 


degrees of freedom. The results of the analysis are shown in Table X. 


Ed 





TABLE X 


ANALYSIS OF VARTANCE OF UNCERTAINTY REMAINING 


SOURCE af NS F 


RATE (A) 1 103.25 76.48% 
ITEM LENGTH (B) 2 2.81 2.08 

MREALS (C) 7 46,22 34.17% 
AxB 2 18.06 “335 Sis 
Ax.C y 8.64 6.38 

ie C 14 1.60 1.18 

AxBxC 14 1.34 


TOTAL AT 





¥p<= 0.01 


The results of Table X indicate a statistical significance for the 
rate and trial main effects (Figure 5), while the item length main effect 
was not statistically significant; this insignificance can be seen graph- 
ically in Figure 6 and is explained by the fact that the information to be 
transferred is a constant in each treatment. ‘The rate (Figure 7) main 
effect significance is apparent since twice as much information had to be 
processed at the faster rate of 4 bits/sec. The significance of the trials' 
main effect occurs due to the learning process (i.e., the uncertainty re~ 
duction) which takes place over each trial and at an increased rate as 
learning progressed. 

The rate by item length interaction significance is apparent in Fig- 
ures 7 and 8 by a juxtaposition of the 2-word treatments relative to the 


other treatments for the two rates. The rate by trials interaction sigmi- 
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ficance is readily apparent in Figure 7, and is consistent with expec- 


tations. 


IV. DISCUSSION 


‘ 


This experiment has demonstrated that the information measure provides 
an absolute measure of learning regardless of the number of alternatives 
(i.e., item length), whereas the percentage of correct responses showed 
that the item length main effect is significant. Thus it was possible to 
quantify the difficulty of a VD item in terms of the uncertainty remaining 
after successive trials. This was accomplished by creating lists of equal 
information content (workload) varying in length, differing in difficulty, 
and presented at distinct rates, resulting in making the work/rate condi- 
tion twice as high for the groups with the shorter processing times. The 
results were consistent with the equal workload quantifications and showed 
that the differential in work output (information transferred) was approx- 
imately a factor of two. 

The study has shown that information analysis provides a viable vehicle 
for measuring learning in VD tasks. Since a certain amount of basic educa- 
tion consists in rote learning, it is suggested that this type of analysis 
could be useful in future research to quantify learning tasks and progress. 
It should be possible to devise testing procedures to measure the rate of 
learning an individual can accomplish in order to determine such educa- 
tional functions such as curricula, student placement in stratified class- 
es, Mee ee iident workloads, and the like. Similar applications may be 


possible in training situations. 
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APPENDIX A 


SUBJECT'S INSTRUCTIONS 


You are to participate in a verbal discrimination experiment. You 
will be shown one series of either all 2-word items, all 3-word items, or 
all 4-word items, each item being distinct within the series. This series 
is 10, 12, or 20 items long and will be repeated in various orders for 
eight consecutive trials. Within each item, one word has been arbitrarily 
selected as "correct". Each item will be presented for a fixed length of 
time, followed by a blank space of the same duration. 

It is your task to view the words in each item and guess which one is 
"correct". Once you have made a choice, announce it to the experimenter. 
If your response is "correct", the experimenter will tell you that you are 
"correct"; otherwise, no answer will be given. In each item, the "correct" 
response word will remain the same throughout the experiment. 

Do you have any questions? If not, relax and await the experimenter's 


command to begin. 


I wish to thank you for your assistance and would appreciate it if you 


would not discuss this experiment with other students wno might participate 


in this study. 
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APPENDIX C 
DISTRIBUTION OF CHOICES FOR EACH TEST OVER TRIALS 
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